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BACKGROUND 

Field of the Invention 

[0002] The present invention relates to techniques for solving 
optimization problems within computer systems. More specifically, the present 
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invention relates to a method and an apparatus that uses interval techniques to 
solve a multi-objective optimization problem. 

Related Art 

5 [0003] In many real-world optimization problems, there are often several 

objectives that one would like to optimize. In such cases, rarely do the optima of 
each objective coincide. Hence, one is left with tradeoffs between the individual 
objectives that must be incorporated in the solution. The goal of multi-objective 
optimization is then to determine a set of points that describe the optimal trade- 

10 off s between obj ecti ves . 

[0004] An example of multi-objective optimization is that of minimizing 
price and maximizing performance. A common metric associated with these two 
objectives is the price-performance ratio. This number, however, oversimplifies 
the optimization problem. This oversimplification lies in the implicit assumption 

15 that a unit of price is equal to a unit of performance, which in general is not the 
case. For example, a college freshman and a national lab would most likely 
weight these two objectives differently when purchasing a computer. A more 
insightful approach to the problem is depicted in FIG. 1, which shows the price 
and runtime (inverse performance) of a set of points representing (fictitious) 

20 computers. Expressed in this manner, one would like to minimize each objective. 
[0005] Unfortunately, minimizing both objectives simultaneously is 
generally not possible, and is not the case in this example. The best one can do is 
come up with an optimal trade-off, where it is not possible to improve one 
objective without degrading the other. The filled circles in FIG. 1 are points 

25 which exhibit this optimal trade-off, and comprise what is termed the "Pareto 
front." Obtaining the Pareto front is one of the goals of multi-objective 
optimization, both in identifying optimal points and in providing a sensitivity 
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analysis. This sensitivity analysis considers the shape of the Pareto front. Convex 
portions of the Pareto front (points which lie on the convex hull of all points) 
indicate an ability to satisfy all objectives relative to regions of the Pareto front 
which are nonconvex (the "indented" region of Pareto front in FIG. 1). 
5 [0006] In addition to determining the Pareto front, another goal of multi- 

objective optimization is to identify values of the objective functions' independent 
variables which are mapped to points on the Pareto front. In our example, 
processor speed, memory, system architecture, etc., are all independent variables 
(perhaps constrained) of both price and performance objective functions. One 

1 0 would like to know which sets of these independent variables map to points on the 
Pareto front. Such sets are termed "Pareto optimal sets." 

[0007] While the application of intervals to solving the multi-objective 
optimization problem is new, there are a variety of methods for obtaining the 
Pareto front for analytical expressions. These methods include the weighted 

1 5 objective or aggregate function method, evolutionary algorithms (see "Zitzler, E., 
Deb, D., and L. Thiele (2000) "Comparison of Multiobjective Evolutionary 
Algorithms: Empirical Results," Evolutionary Computing 8(2): 173-195), and 
adjoint-gradient methods (see Nemec, M. and D. W. Zingg (2001) "Towards 
Efficient Aerodynamic Shape Optimization Based on the Navier-Stokes 

20 Equations," 15 th AIAA Computational Fluid Dynamics Conference, AIAA 200 1 - 
2532). Each of these methods has its benefits and detractions. The aggregated 
function method turns the problem into a single objective optimization by 
weighting each objective. For example, if we have n objectives, {/},..., f n }, we 
wish to simultaneously minimize, then one can minimize the fitness function 

25 
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for all combinations of w, such that 0 < Wj <, \ and 

i=\ 

5 

[0008] Although simple in concept, there are several disadvantages to this 
method. The first is that uniform variations in the weightings space do not evenly 
map out the Pareto front. A second, and more substantial, disadvantage is that 
this method cannot capture nonconvex regions of the Pareto front. A third 
10 disadvantage is that the method does not guarantee finding all solutions. (Note 
that this disadvantage is to common to all existing solution methods.) 

[0009] Hence, what is needed is a method and an apparatus for 
determining a Pareto front for a multi-objective optimization problem without the 
above-described problems. 

15 

SUMMARY 

[0010] One embodiment of the present invention provides a system that 
uses interval techniques to solve a multi-objective optimization problem. During 
operation, the system receives a representation of multiple objective functions 

20 (//,..., f n ) at a computer system, wherein (/},... J n ) are scalar functions of a 
vector x = (x If x n ). The system also receives a representation of a domain of 
interest for the multiple objective functions. Next, the system performs an 
interval optimization process to compute guaranteed bounds on a Pareto front for 
the objective functions (/},...,/,), wherein for each point on the Pareto front, an 

25 improvement in one objective function cannot be made without adversely 
affecting at least one other objective function. While performing the interval 
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optimization process, the system applies a direct-comparison technique between 
subdomains of the domain of interest to eliminate subdomains that are certainly 
dominated by other subdomains. 

[0011] In a variation on this embodiment, performing the interval 
5 optimization process additionally involves applying a gradient technique to 

eliminate subdomains that do not contain local Pareto optima. A subdomain [x], 
is eliminated by the gradient technique if an intersection of certainly negative 

gradient regions C y for each objective function fj is non-empty, Qc y (jx] y ) * 0, 

7=1 

wherein the certainly negative gradient region Cj for objective function fj is the 
10 intersection of N ; flx], ) (the negative gradient region associated with the 

minimum angle 0 } of the gradient of fj over the subdomain [x]/) and N y ([x], ) (the 

negative gradient region associated with the maximum angle Oj of the gradient of 

fj over the subdomain [x],-). 

[0012] In a further variation, the system performs an iterative process that, 
15 (1) bisects remaining subdomains that have not been eliminated by the gradient 
technique, and (2) applies the gradient technique to eliminate bisected subdomains 
that do not contain a local Pareto optimum. 

[0013] In a further variation, bisecting a subdomain involves bisecting the 
subdomain in the direction that has the largest width of partial derivatives of all 
20 objective functions (/}, . . . , f n ) over the subdomain. 

[0014] In a further variation, the direct-comparison technique is applied 
once for every n iterations of the gradient technique. 

[0015] In a further variation, the iterations continue until either a 
predetermined maximum number of iterations are performed, or the largest area of 
25 any subdomain is below a predetermined value. 
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[0016] In a variation on this embodiment, a subdomain U certainly 
dominates a subdomain V if every point ugU dominates every point vgV, 
wherein a point u dominates a point v under minimization if, <> v h i = 1 , . . . , n, 
and Ui < v, for some / g {1, n). 

5 

BRIEF DESCRIPTION OF THE FIGURES 
[0017] FIG. 1 presents a graph of price versus performance for computer 
systems. 

[0018] FIG. 2 depicts a Pareto front. 
10 [0019] FIG. 3 illustrates a Pareto optimal set. 

[0020] FIG. 4A illustrates a non-positive gradient region for a first 
objective function in accordance with an embodiment of the present invention. 

[0021] FIG. 4B illustrates a non-positive gradient region for a second 
objective function in accordance with an embodiment of the present invention. 
15 [0022] FIG. 4C illustrates overlapping non-positive gradient regions in 

accordance with an embodiment of the present invention. 

[0023] FIG. 5A illustrates a first non-positive gradient region for a point 
which is Pareto optimal in accordance with an embodiment of the present 
invention. 

20 [0024] FIG. 5B illustrates a second non-positive gradient region for the 

point which is Pareto optimal in accordance with an embodiment of the present 
invention. 

[0025] FIG. 6A illustrates a non-positive gradient region associated with a 
minimum gradient angle for a subdomain in accordance with an embodiment of 
25 the present invention. 
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[0026] FIG. 6B illustrates a non-positive gradient region associated with a 
maximum gradient angle for the subdomain in accordance with an embodiment of 
the present invention. 

[0027] FIG. 6C illustrates a certain non-positive gradient region for the 
subdomain in accordance with an embodiment of the present invention. 

[0028] FIG. 7 presents a flow chart of an interval optimization process for 
a multi-objective function in accordance with an embodiment of the present 
invention. 

[0029] FIG. 8 presents a more-detailed flow chart for the interval 
optimization process in accordance with an embodiment of the present invention. 

DETAILED DESCRIPTION 
[0030] The following description is presented to enable any person skilled 
in the art to make and use the invention, and is provided in the context of a parti- 
cular application and its requirements. Various modifications to the disclosed 
embodiments will be readily apparent to those skilled in the art, and the general 
principles defined herein may be applied to other embodiments and applications 
without departing from the spirit and scope of the present invention. Thus, the 
present invention is not intended to be limited to the embodiments shown, but is 
to be accorded the widest scope consistent with the principles and features 
disclosed herein. 

[0031] The data structures and code described in this detailed description 
are typically stored on a computer readable storage medium, which may be any 
device or medium that can store code and/or data for use by a computer system. 
This includes, but is not limited to, magnetic and optical storage devices such as 
disk drives, magnetic tape, CDs (compact discs) and DVDs (digital versatile discs 
or digital video discs), and computer instruction signals embodied in a 
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transmission medium (with or without a carrier wave upon which the signals are 
modulated). For example, the transmission medium may include a 
communications network, such as the Internet. 

5 Interval Computations 

[0032] Note that interval computation provides an automatic means for 
bounding roundoff error. Rather than representing a number by a single floating 
point value, which may or may not exist in machine representation, an interval 
represents a number by machine representable lower and upper bounds which 

10 contain the desired value. Interval computation uses directed or outward rounding 
such that the resulting interval always contains the mathematical result. In 
addition to bounding roundoff error, interval computation provides a rich 
environment for performing set theoretic operations. One of the most powerful 
aspects of interval computation, however, is that in performing a single function 

15 evaluation over an interval, one obtains rigorous bounds of that function over the 
entire interval Depending on the value of these bounds, one can prove or 
disprove certain conjectures. We leverage this feature in multi-objective 
optimization to eliminate subdomains in which we can prove no point is Pareto 
optimal. In doing so, we capture all Pareto optimal points. In essence, intervals 

20 allow one to develop computer techniques, which deal with continua rather than 
discrete points, and as a result one can perform proofs via computers. 

[0033] In the next section we utilize the objective function derivatives to 
formulate a differential definition for local Pareto optima, which will become the 
basis for the interval-differential formulation. We later present two 

25 complimentary techniques for solving the multi-objective problem: (1) a direct- 
comparison technique, which can be used to solve the global problem, but suffers 
from inefficiency, and (2) an interval version of the differential formulation, 
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which efficiently solves for local optima. The combination of these two interval 
techniques results in a composite technique, which is guaranteed to find all global 
Pareto optimal sets and their projection on the Pareto front. 



Multi-Objective Concepts and Definitions 

[0034] In this section, we briefly formalize concepts and define terms used 
in multi-objective optimization. We begin by presenting an analytical example, 
and once the multi-objective optimization concepts have been established through 
this example, we generalize the concepts. 

[0035] Consider a case with two objective functions which represent the 
distance of a point (x u x 2 ) from points (-V2, 0) and ( 1 /2,0), 



[0036] The individual minima of f\ and fi are the points (-V2, 0) and 
(V2, 0), respectively, so the objectives are minimized at different points in the 
domain, as is generally the case in multi-objective optimization. What we hope to 
achieve for such a set of objective functions is an optimal trade-off in objectives. 
This optimal trade-off can be determined by projecting all the points in this 
domain into objective space, as depicted in FIG. 2. 

[0037] In FIG. 2 the projection of points (x u x 2 ) e ([-1,1], [- 1 /2, 1 /2]) into 
objective space (fufi) is indicated by the crosshatched region. (Some points are 
projected above and to the right of the crosshatched region). The points which lie 
on the bold line comprise the Pareto front for this pair of functions. Points on the 




(1) 



which we want to minimize in a two-dimensional domain 



(x u x 2 )e([-lM[-V2,V2]). 



9 



Attorney Docket No. SUN-P8774-EKL 



Inventor: Gregory R. Ruetsch 



ARP H:\SUN MICROSYSTEMS\SUN-P8774-EFCL\SUN-P8774-EKLAPPLlCATION.DOC 



Pareto front are nondominated, in that no point exists that can improve one 
objective without degrading the other.) When projected to objective space, the 
points in this domain fill the region above the diagonal line. The diagonal line is 
called the "Pareto front" and represents the optimal trade-off in that there can be 
5 no improvement towards minimizing one objective which doesn't adversely affect 
the other objective. (Since the minimum of each objective is zero, this condition 
can be interpreted geometrically by requiring the rectangle whose diagonal 
connects the origin and the point in question to be empty.) On the other hand, all 
points which lie above the Pareto front can simultaneously improve both 

1 0 objectives by moving towards the Pareto front. 

[0038] In addition to determining the Pareto front, the corresponding 
points in the domain (x u x 2 ) which project onto the Pareto front are desired. Such 
a point is called "Pareto optimal," and the collection of all such points the "Pareto 
optimal set." For our example, the Pareto optimal set includes all points in the line 

15 segment connecting the two individual minima, depicted in FIG. 3. FIG. 3 
illustrates contours (dashed lines) and the Pareto optimal set (solid line) for 
functions f\ and/ 2 in Equation (1). The value of these functions are the distances 
from points (-V2, 0) and (+Y2, 0), respectively, which result in the circular 
contours. The Pareto optimal set for this example comprises the points on the line 

20 connecting the two individual minima, and projects into the Pareto front in 
objective space. Note that any point in the domain that is not in the optimal 
Pareto set can improve both objectives by moving along a path towards the line 
which comprises the Pareto optimal set. 

[0039] With the concepts of Pareto front and Pareto optimal set for the 

25 above analytical expressions established, we now turn our attention to 
generalizing these concepts to a case with n objective functions in a D- 
dimensional domain. In order to generalize the Pareto front to n dimensions, it is 
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useful to establish the concept of dominance. If u and v are rc-dimensional 
vectors, then under minimization u is said to dominate v, denoted as u < v, if: 

w, £ V/, f=l,... s n\ and 
5 Ui< v, for some i e {1, n}. 

[0040] Applying dominance to the Pareto concepts, we say the Pareto 
front contains points which are nondominated solutions: solutions where an 
improvement in one objective cannot be made without adversely affecting at least 
10 one other objective. Generally, if we wish to minimize n objectives {/i, . . ., f n ) 
within a particular domain Q of a Z)-dimensional space x = (x\ 9 . . x D \ and we 
define an objective vector/x) = (/i(x), . . f n (x)) 9 then a point x € Q is Pareto 
optimal if: 

15 f(x') * f(x) V x'e Q (2) 

[0041] The definition of Pareto optima in Equation (2) utilizes the 
function evaluations. This point definition becomes the basis for the interval 
direct-comparison method in a following section. In the next section we utilize 
20 the objective function derivatives to formulate a differential definition for local 
Pareto optima, which will become the basis for the interval-differential 
formulation. 

Differential Formulation 
25 [0042] If the objective functions (/I (x), /„(x)} are continuous and 

differentiable, then it is helpful to leverage the gradient information of these 
functions in determining local Pareto optima. Just as finding local extrema in 
single-objective optimization does not guarantee that these points are global 
extrema, finding local Pareto optima does not imply that these points are 
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contained in the Pareto optimal set. However, finding points that are local Pareto 
optima can assist in obtaining the Pareto optimal set. This is especially true in the 
case of interval methods, where consistency checks can be combined with 
capturing local optima to determine global optima. 
5 [0043] Local Pareto optimality requires that at a point x, no differential 

displacement vector 5r exists such that: 

f(x + 8r) < f(x). 

10 If we denote d(x,8r) as the vector of directional derivatives of the objective 
functions along 8r: 

</,(x,5r)= Vy;| x -8r, 

15 then a Taylor expansion of f(x) results in the condition for local Pareto optimality: 
a point x is locally Pareto optimal if there is no differential displacement vector Sr 
such that: 

d(x, Sr) < Z (3) 

20 

where Z is the zero vector, i.e. Z, =0 for / = 1 , . . . , «. 

[0044] The condition of Equation (3) can be geometrically interpreted 
as follows. For each objective there is a (D-l)-dimensional plane which is normal 
to the gradient of ft at a point x. This plane delineates two semi-infinite regions, 

25 one where the local (linearized) gradient is positive, and one where it is negative. 
Any differentially small displacement into the negative gradient region results 
improving the objective function, and Equation (3) is satisfied when the 
intersection of the such regions, one for each objective, is empty. If we represent 
the negative gradient region for f t at point x by Af/(x), then Equation (3) is satisfied 

30 when: 
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f|^(x)nft = 0 (4) 

m 

The domain Q appears here in order to account for points which lie on the 
5 boundary of Q. In effect, for points on the boundary, this acts like an additional 
objective function. For interior points, the presence of Q is inconsequential. 

[0045] The application of the condition in Equation (4) to the example 
problem in Equation (1) is demonstrated in FIGs. 4A-4C. In FIGs. 4A and 4B, the 
objectives f\ and^ are dealt with separately. In each plot, the gradient of the 

10 objective at some point is drawn, along with Ni n Q (the intersection of the 

negative gradient region and the domain) by the shaded regions. In FIG. 4C, these 
two figures are combined, showing a nonempty region corresponding to 
Mn^n Q. Any differential displacement into this crosshatched region will 
improve both objectives, and as a result the point is not locally Pareto optimal. 

1 5 [0046] FIGs. 5 A and 5B illustrate negative gradient regions Nj at a point 

which is Pareto optimal. N\ and Ni are shown independently in the two diagrams. 
Here the gradients are co-linear but opposite in direction, and as such the 
intersection N\ n N2 is empty. Therefore, this point is locally Pareto optimal. 
Note that the only way an interior point in a two-objective optimization problem 

20 can be Pareto optimal is when the gradients are co-linear but opposite. 

[0047] In this section, we have established a differential formulation for 
identifying local Pareto optima. Application of this methodology as it stands is 
difficult in that one needs to perform this evaluation at every point in domain Q. 
One can devise many "shotgun" methods using this differential formulation, such 

25 as seeding the domain with points and using the gradient information to traject 
points towards the optimal Pareto set. The problem with such methods is that 
they are not guaranteed to capture all Pareto optima. In the next section, we apply 
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interval methods to the differential formulation which, along with in interval 
version of Equation (2), results in a technique which is guaranteed to capture all 
Pareto optima. 

5 Interval Concepts 

[0048] Interval methods grew out of the desire to control roundoff error in 
floating point computations. The idea is that rather than using a single floating 
point value to represent a number, which would incur an error if the number is not 
machine representable, a number is represented by upper and lower bounds which 
1 0 are machine representable. Interval arithmetic is performed in a way to guarantee 
containment. Intervals are described in more detail in U.S. Patent No. 6,629,120, 
entitled "Method and Apparatus for Performing a Mask-Driven Interval 
Multiplication Operation," by inventors William G. Walster and Dmitri Chiraev. 
[0049] In addition to operators for arithmetic and function evaluation, 
1 5 intervals have a rich set of relational operators. There are certainly true 
operations, for example: 

X<Y o x<y VxeXand yeY 
20 as well as possibly true operations: 

p 

X < Y <=> 3xeX and y e Y | x < y 

These same ideas hold for all relational operators. 
25 [0050] Now that some basic concepts of interval arithmetic and 

computation have been discussed, we apply these concepts to multi-objective 
optimization, starting with the interval definition of dominance. 
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Interval Dominance And The Direct-comparison Method 

[0051] We can extend the notions of certainly and possibly used to define 
the basic interval relational operators to that of dominance. An interval vector 
U = (f/i(x) 5 . . . , U n (x)) certainly dominates an interval vector V according to the 
5 following definition: 

U-W o u^v VueVandveV (6) 
In terms of the infima and suprema of the components of U and V, we say that 
10 U-Wif: 

w, < v, / = 1, n and 

u i < v, for some i e {1, n). 

p 

1 5 Likewise, U is said to possibly dominate V, denoted as U -< V if: 
ut < v, i = 1 5 n. 

One could apply the definition of certain dominance directly to obtain an interval 
20 technique for determining the Pareto front. One would simply search over a set of 

subdomains covering the domain q, and eliminate any subdomains which were 

certainly dominated. Then the remaining subdomains would be bisected, and the 

procedure is repeated until some stopping criterion is met. 

[0052] While this method will work in that no Pareto optimal points will 
25 be eliminated, there are several disadvantages inherent in this method. The main 

disadvantage is that the number of comparisons to determine certain dominance 

grows rapidly with number of subdomains. Performance-wise this becomes costly 

as the Pareto front is refined. 
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[0053] One aspect of this direct-comparison method that is both 
advantageous and disadvantageous is that it is a global method. This is 
disadvantageous with respect to parallelization in a clustered environment-some 
message passing is needed for comparison between all subdomains within an 
iteration. The global nature of the direct-comparison method is advantageous in 
that it results in global Pareto optima. This is important since the interval version 
of the differential formulation produces all the local Pareto optima, and some 
consistency check is needed to eliminate those local optima which are not global. 
The direct-comparison method provides this consistency check. Having 
developed the direct-comparison method, the only remaining piece in obtaining a 
complete technique is to extend the differential formulation to intervals. 

Interval-differential Formulation 

[0054] In the direct-comparison method above, we used the concept of 
1 5 certain dominance through the evaluation of the objectives over intervals to 
eliminate subdomains, which are certainly dominated, and therefore contain no 
Pareto optimal points. In the interval-differential formulation, we again look to 
develop a criterion which enable us to remove subdomains which are certainly 
dominated, however this criterion is based on the objective function derivatives. 
20 [0055] In the point differential formulation, determining local Pareto 

optima requires the evaluation of the gradient of objective functions. The 
magnitude of the gradients is inconsequential to the formulation, it is the direction 
of the gradients that determined the negative gradient regions, N h and therefore 
local dominance. In a D-dimensional domain, the direction of the gradient of each 
25 objective function can parameterized by ZM variables. For example, in the two- 
dimensional domain of Equation (1), we can define the direction of the gradient of 
the y-th objective by the angle 6 y . If we extend this to intervals, then the interval 
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10 



gradient of the y-th objective function evaluated over the /-th subdomain, [x]„ is: 
G/[x]/) = [V£]([x]/) 

5 takes on a range of directions [0j ,9 } \ Associated with this range of directions is 

a range of semi-infinite negative gradient region, denoted as N 7 . Formally we 
have: 

Nj(x) c N/[x],) Vx e [x], 

10 

In the point differential formulation, regions where the intersection of the domain 
and all N t is non-empty indicated that such a point is not Pareto optimal. We now 
extend this idea to the interval case. To eliminate a subdomain, we need to 
establish that every point x in this subdomain satisfies: 

15 

(V y (x) * 0. (7) 

The intersection with the entire domain Q is not included here, as it was in the 
point formulation-we consider boundary points later in this section. We would 
20 like to find an expression analogous to Equation (7) using N y . Suppose we can 
determine a certainly negative gradient region for objective^, denoted by C,, 
which is defined as the subset of N, that is common to N/x) for all x e [x],: 

C/M,)ctf/x) Vxe[x], 

25 

With knowledge of C, we can guarantee that Equation (7) holds at all points in the 
subdomain if: 

nc,(M,) * 0- 

7=1 
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The remaining issue is to determine C/([x],). This region is drawn for a single 
objective,/!, in FIGs. 6A-6B. FIG. 6A shows the negative gradient region of f\ 
associated with the minimal angle 0 ] , of the gradient over the subdomain [x],. 

FIG. 6B shows the negative gradient region of f\ associated with the maximum 
angle 0 X of the gradient over this subdomain. These negative gradient regions are 

denoted by N\ and N x , respectively. FIG. 6C shows the intersection of these two 

regions, which defines the certainly negative gradient region for objective f\. We 
can define such a region for all objectives: 



As a result, we now have a condition which, when satisfied, shows that every 
point in a subdomain [x], is not locally, and therefore not globally, Pareto optimal: 



[0056] The boundary of Q in the point formulation was accounted for by 
taking the intersection of the N/s with the domain Q. When operating over a finite 
area subdomain, there is no extension to account for the boundary in such a 
simple manner. One needs to account for the boundaries separately. For 
example, for two objective functions f\ and/> in a domain of x e ([-1,1], [- 1 /2, 1 /2]), 
one needs to solve two problems. The first using Ci n C2, or Equation (8), as a 
criterion for eliminating subdomains in the interior, and the second using 
Ci n Q%r\ Q as a criterion for eliminating subdomains of the semi-degenerate 
intervals (-1, [- 1 /2, 1 / 2 ]), (1, [- 1 /2, 1 / 2 ]), ([-1,1], - 1 / 2 ), and ([-1,1], V2). An application 



C/ = Ni(W/)n N, ([x],) 




(8) 
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of the direct-comparison method over all subdomains from these various regions 
merges these separate optimization problems. 

[0057] The criterion in Equation (8) for eliminating subdomains which do 
not contain any local Pareto optima, along with the definition of interval 
5 dominance of Equation (6) which be used to eliminate subdomains which are not 
global Pareto optimal, can be combined in a robust and efficient implementation 
of a multi-objective optimization code. Equation (8) provides an efficient means 
for computing local Pareto optima, and Equation (6) can be applied as a 
consistency check to eliminate any regions which are local but not global optima. 

10 

System Implementation 

[0058] One embodiment of the present invention implements a system that 
uses the interval-differential formulation, from Equation (8), and the direct- 
comparison method, from Equation (6). This embodiment includes a single loop, 

1 5 which performs eliminations of subdomains within each "generation" or iteration. 
[0059] Referring to the flowchart in FIG. 7, the system first receives a 
representation of multiple objective functions (fj , . . ., f n ) and a domain of 
interest (step 702). Next, the system stores this representation in a memory in a 
computer system (step 704), and performs an interval optimization process to 

20 compute guaranteed bounds on the Pareto front for the multiple objective 
functions (step 706). 

[0060] The initial condition, or first iteration, of this loop operates on a 
single "subdomain" which covers the entire domain of interest. Referring to the 
flowchart in FIG. 8, every few iterations through the loop a consistency check for 

25 global Pareto optima is performed using the direct-comparison method from 
Equation (6) (step 802). This eliminates any subdomains which are certainly 
dominated (step 802). The frequency at which the direct-comparison method 
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occurs is a parameter set by the user. 

[0061] Next, the loop determines if the subdomains can be eliminated on 
grounds of not containing a local Pareto optimum via the interval-differential 
formulation in Equation (8) (step 804). The certainly negative gradient regions 
5 are represented by interval angles. 

[0062] To accommodate problems of more than two independent 
variables, one simply considers the projections of N^([x]/) and N y ([x]/) on all 

possible two-dimensional coordinate planes. For the case of two independent 
variables, one finds certainly negative gradient regions on the x\-X2 plane. In three 
10 dimensions this is done on three planes, (x\-x 2 , x r x^ and x 2 -x 3 ), and in D 

dimensions this operation is performed on D(D-1) such planes. Since the semi- 
infinite regions N/([x],) and N . ([x],) are bounded by Z)-dimensional planes, the 

projection of these regions into each two-dimensional subspace is simply done 
using the appropriate partial derivatives for the subspace to form the gradient, and 

1 5 then proceeding as if it were a two-dimensional problem. 

[0063] The intersection of the certainly negative gradient regions within 
each coordinate plane is performed using these interval angles, accounting for 
branch cuts when required. While the number of coordinate planes is 0(D 2 ) in 
number of dimensions, one must remember that the operation performed on each 

20 coordinate plane is a simple intersection. The evaluation of the objective 
gradients, which in general is more time-consuming, is only 0(D). 

[0064] If the intersection of certainly negative gradient regions for all such 
planes is nonempty, then the subdomain can be removed, meaning they are not 
advanced into the next iteration. The subdomains that do not satisfy this 

25 condition are bisected (step 806). The bisection is performed in the direction that 
has the largest width of partial derivatives of all objective functions oyer the 
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subdomain. The rationale behind bisecting in this direction is that we want the 
next iteration of subdomains to have the certain negative gradient regions as large 
as possible, thus increasing the likelihood that Q * 0. This is achieved if we 
bisect a subdomain in the direction where the largest width of the objective 
functions' partial derivative occurs. 

[0065] At the end of the loop the system determines if a termination 
condition is satisfied (step 808). For example, the termination condition can be 
satisfied if either a specified number of iterations is performed, or the largest area 
of any interval box (Fi([x]„ F 2 ([x],) is below some user specified value. If the 
termination condition is satisfied, the process is complete. Otherwise, the system 
returns to step 802 to perform another loop iteration. 

[0066] The foregoing descriptions of embodiments of the present 
invention have been presented for purposes of illustration and description only. 
They are not intended to be exhaustive or to limit the present invention to the 
forms disclosed. Accordingly, many modifications and variations will be apparent 
to practitioners skilled in the art. Additionally, the above disclosure is not 
intended to limit the present invention. The scope of the present invention is 
defined by the appended claims. 
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